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Publication Language: English 
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Fulltext word count: 1 4344 

English Abstract: 



Although negative example can be highly useful to better understand the user's needs in content-based image 
retrieval, it was considered by few authors. A content-based image retrieval method according to the present 
invention addresses some issues related to the combination of positive and negative examples to perform a more 
efficient image retrieval. A relevance feedback approach that uses positive example to perform generalization and 
negative example to perform specialization is described herein. In this approach, a query containing both positive 
and negative example is processed in two general steps.- The first general step considers positive example only in 
order to reduce the set of images participating in retrieval to a more homogeneous subset. Then, the second general 
step considers both positive and negative examples and acts on the images retained in the first step. Mathematically, 
relevance feedback is formulated as an optimization of intra and inter variances of positive and negative examples. 

French Abstract: 

Bien qu'un exemple negatif puisse etre tres utile pour mieux comprendre les besoins des utilisateurs dans un systeme 
d'extraction d'images fonde sur le contenu, celui-ci a ete rarement employe. La presente invention concerne un 
procede d'extraction d'images fonde sur le contenu qui aborde certains problemes lies a la combinaison d'exemples 
positifs et d'exemples negatifs pour obtenir une extraction d'images plus efficace. Une approche qui consiste a 
realiser un controle de pertinence utilisant un exemple positif pour effectuer une generalisation et un exemple 
negatif pour effectuer une particularisation est decrite. Dans cette approche, une requete contenant a la fois un 
exemple positif et un exemple negatif est traitee en deux etapes generates. La premiere etape generale consiste a 
prendre en compte uniquement l'exemple positif afin de reduire l'ensemble d'images objets de 1'extraction a un 
sous-ensemble plus homogene. Ensuite, la seconde etape generale consiste a prendre en compte l'exemple positif et 
l'exemple negatif et a traiter les images retenues dans la premiere etape. D'un point de vue mathematique, le controle 
de pertinence est decrit comme une optimisation des variances intra et inter de l'exemple positif et de l'exemple 
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...process. 

(0019] Vasconcelos et aL in "Learning from User Feedback in 

Image Retrieval Systems." in Neural Information Processing Systems 12, 

Denver, Colorado, 1 999 disclose a content-based image retrieval methods 

involving negative example from the second category. More specifically, they propose a Bayesian model for image 
retrieval, operating on the assumption 

that the database is constituted of many image classes. When performing 
retrieval, image classes that... 
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A method and system for automatically harvesting and screening plant embryos in multiple stages to 
identify those embryos that are suited for incorporation into manufactured seeds are provided. The 
method includes generally three steps. First, plant embryos are carried by a conveyor (34) and are 
automatically sorted according to their rough size/shape and also singulated into discrete embryo units, 
for example by vibrational sieving. Second, the sorted and singulated plant embryos are transferred to a 
classification conveyor (34) and are classified using a first classification method. For example, each 
embryo may be imaged by a camera (38) and the image is used to ascertain the embryo's more precise 
size/shape. Third, for those embryos that have passed the first classification method, a second 
classification method is applied. For example, a pre-developed classification algorithm to classify 
embryos according to their putative germination vigor may be applied to the same image used in the first 
classification method, to identify those embryos that are likely to germinate and to remove the other 
from the conveyor (34) for example by a timed air/liquid jet (42). 

Abstract Word Count: 181 
NOTE: 1 

NOTE: Figure number on first page: 1 
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Specification: ...subsequent classification stage. Second, the sorted and singulated plant embryos are 
classified using a first classification method. For example, each of the embryos may be imaged by a 
camera and the image is used to ascertain the embryo's size/shape. Those embryos within a predefined 

size/shape range are considered to have passed the first classification embryos desirable for 

incorporation into manufactured seeds. For example, a pre-developed classification algorithm to classify 
embryos according to their putative germination vigor (i.e., likelihood of successful germination) may 
be applied to the same image used in the first size/shape classification method, to identify those 
embryos that are likely to germinate. The embryos that have passed both the first and second 
classification methods are identified as suitable for incorporation into manufactured seeds. 
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According to one aspect, the first and second classification methods are carried out along a 
classification conveyor belt while the sorted and singulated embryos are transported thereon. In some 
classification methods, it is preferred that the embryos are generally arranged in a single file on the 
classification conveyor belt. Various means for achieving the single file configuration are proposed. For 
example, the classification conveyor belt may be arranged generally perpendicularly to the porous 
conveyor belt on which the embryos are sorted and singulated. According to this configuration, the... 
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A cardiac view of a medical ultrasound image is automatically identified (24, 26, 28). By grouping 
different views into sub-categories, a hierarchal classifier identifies the views. For example, apical views 
are distinguished (24) from parasternal views. Specific types of apical or parasternal views are identified 
(26, 28) based on distinguishing between images of the geneses. Different features are used for 
classifying, such as gradients, functions of the gradients, statistics of an average frame of data from a 
clip or sequence of frames, or a number of edges along a given direction. The number of features used 
may be compressed (22), such as by classifying a plurality of features into a new feature. For example, 
alpha weights in a model of features and classes are determined and used as features for classification 

French Abstract: 

^invention concerne une vue cardiaque d'une image a ultrasons medicale automatiquement identifiee 
(24, 26, 28). Par groupage des differentes vues en sous-categories, un classificateur hierarchique 
identifie les vues. Par exemple, des vues apicales sont distinguees (24) des vues parasternales. Les types 
specifiques de vues apicales ou parasternales sont identifies (26, 28) sur la base de la distinction entre les 
images de geneses. Les caracteristiques differentes sont utilisees afin de classifier, notamment des 
gradients, des fonctions de gradients, des statistiques d f une trame de donnees moyenne a partir d'un clip 
ou d f une sequence de trame, et un certain nombre de bords le long d'une direction donnee. Le nombre de 
caracteristiques utilisees peut etre comprime (22), notamment par classification de plusieurs 
caracteristiques en une nouvelle. Par exemple, les poids alpha dans un modele de caracteristiques et de 
classes sont determines et utilises en tant que caracteristiques de classification. 
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Detailed Description: 

...cava, suprasternal north long axis of the aorta, and suprasternal notch short axis of the aortic arch. To 
assist diagnosis, the views of cardiac ultrasound images are automatically classified. The view may be 
unknown, such as associated with a random transducer position or other not specifically defined view. 

4 

[0021] A classifier classifies an unknown view as either apical, parasternal, subcostal, unknown or 

supracostal view, and then further classifies the view into one of the respective subclasses where the 
view is not unknown. Rather than one versus all or one versus one schemes to identify a class (e.g., 

distinguishing between from fewer number of classes at each level). By separating the classification, 

specific views may be more accurately identified. A specific view in any of the sub-classes may include 
an "unknown view" option, such as A2C, A4C and unknown options for apical sub-class. Single four or 
fifteen-class identification may be used in other embodiments. 

[00221 Identification is a function of any combination of one or more features. 

For example, identification is a function of gradients, gradient functions, number of edges, or statistics 
of a frame of data averaged from a sequence of images. Features used for classification, whether for 
view identification or diagnosis based on a view, may be generated by compressing information in other 
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[00231 The classification outputs an absolute identification or a confidence or likelihood measure that 
the identified view is in a particular class. The results of view identification for a medical image can be 
used by other automated methods, such as abnormality detection, quality assessment methods, or other 
applications that provide automated diagnosis or therapy planning. The... 
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Corporate Source: Insightful Corporation, Seattle, WA 98109-3044 

Source: Proceedings - International Conference on Pattern Recognition v 16 n 2 2002. 

Publication Year: 2002 

CODEN:PICREG ISSN: 1051-4651 

Language: English 

Document Type: JA; (Journal Article) Treatment: T; (Theoretical); X; (Experimental) 
Journal Announcement: 061 2W3 

Abstract: A challenging problem in image retrieval is the combination of multiple features and similarity models. 
We pose the retrieval problem in a two-level classification framework with two classes: the relevance class and the 
irrelevance class of the query. The first level maps high-dimensional feature spaces to two-dimensional probability 
spaces. The second level uses combinations of simple linear classifiers trained in these multiple probability spaces to 
compensate for errors in modeling probabilities in feature spaces. Similarity is computed using joint posterior 
probability ratios instead of the common way of computing distances in feature spaces and taking their weighted 
combinations. Experiments on two groundtruthed databases show that the proposed classification framework 
performs significantly better than the common geometric framework of distances and allows a well-defined and 
effective way of combining multiple features and similarity measures, copy 2002 IEEE. 1 1 Refs. 
Descriptors: *Content based retrieval; Classification (of information); Problem solving; Feature extraction; Query 
languages; Conformal mapping; Probability 

Identifiers: Retrieval problem; Classification framework; Ground truthed databases; Posterior probability 
Classification Codes: 
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723.2 (Data Processing); 716.1 (Information & Communication Theory); 723.4 (Artificial Intelligence); 723.5 
(Computer Applications); 723.1 (Computer Programming); 922.1 (Probability Theory) 
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921 (Applied Mathematics); 922 (Statistical Methods) 
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Title: Multi-class relevance feedback content-based image retrieval 
Author: Peng, Jing 

Corporate Source: Department of Electrical Engineering Tulane University, New Orleans, LA 701 18, United 
States 

Source: Computer Vision and Image Understanding v 90 n 1 April 2003. p 42-67 
Publication Year: 2003 
CODEN:CVIUF4 ISSN: 1077-3142 
Language: English 
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Abstract: Relevance feedback methods for content-based image retrieval have shown promise in a variety of image 
database applications. These techniques assume two-class relevance feedback: relevant and irrelevant classes. While 
simple computationally, two-class relevance feedback often becomes inadequate in providing sufficient information 
to help rapidly improve retrieval performance. In this paper we propose a multi-class form of relevance feedback 
retrieval to try to exploit multi-class information. For a given query, we use a Chi **2 analysis to determine the local 
relevance of each feature dimension with multi-class relevance feedback. This information is then used to customize 
the retrieval metric to rank images. By exploiting multi-class information, our method is able to create flexible 
metrics that better capture user perceived similarity. In a number of image data sets, the method achieves a higher 
level of precision with fewer iterations, demonstrating the potential for substantial improvements over two-class 
relevance feedback retrieval, copy 2003 Elsevier Science (USA). All rights reserved. 48 Refs. 
Descriptors: *Content based retrieval; Computer vision; Database systems; Vectors; Feedback 
Identifiers: Multi-class relevance feedback 
Classification Codes: 

723.2 (Data Processing); 723.5 (Computer Applications); 741.2 (Vision); 723.3 (Database Systems); 921.1 
(Algebra) 

723 (Computer Software, Data Handling & Applications); 741 (Light, Optics & Optical Devices); 921 (Applied 
Mathematics) 

72 (COMPUTERS & DATA PROCESSING); 74 (LIGHT & OPTICAL TECHNOLOGY) ; 92 (ENGINEERING 
MATHEMATICS) 



16/5/1 (Item 1 from file: 8) Links 

Fulltext available through: SPIE - The International Society of Optical Engineering USPTO Full Text Retrieval 
Options 

Ei Compendex(R) 

(c) 2007 Elsevier Eng. Info. Inc. All rights reserved. 
08823372 E.I. No: EIP01 226522782 
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Abstract: In this paper, Content-Based Image Retrieval from a Hierarchically organized database (HCBIR) is 
proposed. Images in the database are categorized into different classes based on human perception. The 
characteristics of each class is represented by the prototypes extracted from images in the class by using the 
Unsupervised Optimal Fuzzy Clustering (UOFC) algorithm. Based on the proposed Image-Class Matching Distance 
(ICMD), a modification of the Earth Mover's Distance (EMD), the relevant class of the query image can be selected. 
The rank of candidate images is determined in the descending order of similarity, and a class with the most number 
of high ranking images is then selected. The search domain is narrowed down and the retrieval efficiency is 
improved greatly. A comparison is done between HCBIR approach and nonhierarchical CBIR (NHCBIR) approach. 
It can be concluded that the HCBIR approach is believed more similar to the process of human vision, and more 
efficient. 26 Refs. 
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Recognition of partially occluded objects in content-based image retrieval 
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Electronic Commerce has propelled the growth of buying and selling of a variety of products through the Internet. 
Often, the electronic catalogs contain pictures comprising of images of these products, either shown exclusively or 
combined with other products. Despite substantial research, facilitating search of an object based on the content of 
an image still remains as a major challenge. This problem of content-based image retrieval is even more difficult 
when multiple objects are present in an image or when they are partially occluded. While the main focus is on the 
recognition of partially occluded objects, in this dissertation, we make several contributions to the area of content- 
based image retrieval. 

First, we have proposed feature extraction methods to support content- based image retrieval based on 
individual objects in images. We have employed rotational invariants using Run Length Code lines to extract shape 
parameters, and texture and shape features to retrieve parameterized image parameters such as roundness, form 
factor, aspect ratio, surface regularity, angle of second moment, entropy, contrast, and mean. RLC lines can be 
directly calculated for area and position measurements with less arithmetic than pixel array techniques. RLC lines 
can distinctly represent shape parameters, which are better discriminating features than parameters such as color and 
texture for recognizing image objects in electronic catalogs. 

Second, we have proposed an object classification method, called Probability Interval Classification (PIC), using 
novel splitting rules, which are based on minimizing the sum of variance and maximizing the difference of 
probabilities of intervals. The splitting rules are given by considering the probabilities of pre-assigned intervals for 
covariates rather than exhaustively searching over all possible splitting values. It provides the user with control of 
the accuracy of the tree by adjusting the number of intervals. The results show that PIC is more stable than the 
exhaustive search method when the learning sample changes, produce better accuracy with reasonable tree size and 
depth, and demonstrates higher precision and recall scores. 

Third, we have developed methods to reconstruct and estimate partially occluded shapes and regions of objects in 
images from overlapping and cutting. We have presented two robust methods for recognizing partially occluded 
objects based on symmetry properties. One is based on the contours of objects, and the other is based on individual 
parts of objects. Our methods have provided simple techniques to reconstruct occluded regions via a region copy 
using the symmetry axis within an object. Based on the estimated parameters for partially occluded objects, we have 
performed object recognition on the classification tree. Since our method relies on reconstruction of the object 
based on the symmetry rather than statistical estimates, it has proven to be remarkably robust in recognizing partially 
occluded objects in the presence of scale changes, rotation, and viewpoint changes. 



16/5/3 (Item 2 from file: 35) Links 
Dissertation Abs Online 

(c) 2007 ProQuest Info&Learning. All rights reserved. 
01747269 ORDER NO: AADAA-I9972009 
Semantic classification in image databases 

Author: Vailaya, Aditya 
Degree: Ph.D. 
Year: 2000 

Corporate Source/Institution: Michigan State University ( 0128 ) 
Adviser: Anil K. Jain 

Source: Volume 6105B of Dissertations Abstracts International. 
PAGE 2628. 195 PAGES 

Descriptors: COMPUTER SCIENCE ; INFORMATION SCIENCE 
Descriptor Codes: 0984; 0723 
ISBN: 0-599-77240-9 

Due to the huge amount of potentially interesting documents available over the Internet, searching for relevant 
information has become very difficult. Since image and video are a major source of these data, grouping images into 
(semantically) meaningful categories using low-level visual features is an important (and challenging) problem in 
content -based image retrieval. Using Bayesian classifiers, we attempt to capture high-level concepts from 
low-level image features. Specifically, we have developed Bayesian classifiers for semantic image classification 
(indoor vs. outdoor, city vs. landscape, and sunset vs. forest vs. mountain), image orientation detection, and object 
detection (detecting regions of sky and vegetation in outdoor images). We demonstrate that a small codebook (the 
optimal codebook size is selected using a modified MDL criterion) extracted from a learning vector quantizer can be 
used to estimate the class-conditional densities of the observed features needed for image classification. We have 
developed an incremental learning paradigm, a feature selection scheme, a rejection scheme, and a classifier 
combination strategy using bagging to improve classifier performance. Empirical results on a large database 
(∼24,000 images) show that semantic categorization and organization of the database using the proposed 
classification schemes improves both retrieval accuracy and efficiency. 
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image retrieval 
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Conference Title: Proceedings of the Fifth Asian Conference on Computer Vision Part vol. 1 p. 87-92 vol. 1 
Editor(s): Suter, D.; Bab-Hadiashar, A. 

Publisher: Asian Federation of Computer Vision Soc , Clayton, Vic, Australia 
Publication Date: 2002 Country of Publication: Australia 2 vol.(xxxii+x+917) pp. 
ISBN: 0 9580256 0 6 Material Identity Number: XX-2002-00694 
Conference Title: Proceedings of Asian Conference on Computer Vision 
Conference Date: 22-25 Jan. 2002 Conference Location: Melbourn, Vic, Australia 
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Language: English Document Type: Conference Paper (PA) 
Treatment: Applications (A); Theoretical (T) 

Abstract: In this paper, we presented a semantically structured image database for content-based image retrieval. 
A class descriptor is proposed to represent each class using a multi-prototype model, which can be obtained by 
using a learning scheme, such as the Unsupervised Optimal Fuzzy Clustering algorithm, on a group of sample 
images manually selected from the class. Based on the proposed Image-Class Matching Distance, a similarity 
measure at the semantic level between an image and classes, images can be annotated by tokens of classes. Hence, 
composite features of images, including low-level descriptors, clays descriptors, and image annotation, are stored 
into a structured feature database corresponding to the semantically structured image database. From experiments, it 
can be concluded that the performance of the semantically structured CBIR system is improved greatly in terms of 
retrieval time and efficiency. ( 1 5 Refs) 
Subfile: B C 
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Publisher: IEEE Comput. Soc , Los Alamitos, CA, USA 
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Abstract: A challenging problem in image retrieval is the combination of multiple features and similarity models. 
We pose the retrieval problem in a two- level classification framework with two classes: the relevance class and the 
irrelevance class of the query. The first level maps high-dimensional feature spaces to two-dimensional probability 
spaces. The second level uses combinations of simple linear classifiers trained in these multiple probability spaces to 
compensate for errors in modeling probabilities in feature spaces. Similarity is computed using joint posterior 
probability ratios instead of the common way of computing distances in feature spaces and taking their weighted 
combinations. Experiments on two groundtruthed databases show that the proposed classification framework 
performs significantly better than the common geometric framework of distances and allows a well-defined and 
effective way of combining multiple features and similarity measures. ( 1 1 Refs) 
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Hierarchical Classification Method for Overviewing Huge Amount of Image Contents. Making a Catalogue 
of Images. 
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Abstract: In order to overview huge amount of image contents efficiently, the hierarchical classification method is 
proposed. The method is characterized by the combination of a template-based classification and an automatic 
clustering, each of which is based on the image features. A classification support environment is implemented, 
which treats several image features as classification viewpoints. According to the constructed classification tree, the 
images are displayed on the electronic book-called the CyberBook-by the means similar to the catalogue. It helps 
finding desired images. The experimental results reveals that the number of referred images for a finding target 
image is reduced by 25% compared with the case of content-based image retrieval, (author abst.) 
Descriptors: binary image; reading(library); classification; image database; cataloging; information retrieval; 
clustering; color image; color; tree(graph) 
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This study introduces techniques for compiling a geologic map on a personal workstation. An image GIS 
database with information relevant to rock-type identification was formed by combining digital image, 
image-derived, and non-image data. Interactive image enhancement techniques, ranging from contrast, brightness, 
and sharpness adjustments, to BAV image colorization are implemented with an easy to understand user interface. 
Scanned aerial photograph examples illustrate the increased interpretability potential using these techniques. 
Statistical and absolute methods for deriving geological measurements from digital images and DEMs, including 
strike, dip and stratigraphic thickness are presented along with implementation flow diagrams. A unique approach to 
classification is introduced. In addition to the image spectral bands, image -derived layers of band ratios and color 
hues are incorporated, along with non-image data in an image GIS database. Rock-types are classified in terms of 
certainty levels using modified parallelepiped and distance classifiers, to improve efficiency. A temporary 
information stack with a scoreboard holds the intermediate results. A rule-based expert system procedural step, is 
used to generalize the intermediate results and assign the pixels to their appropriate classes. Comprehensive 
examples illustrate the proposed classification approach and compare it with traditional methods. 
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Abstract: We discuss data mining based on association rules for two numeric attributes and one Boolean attribute. 
For example, in a database of bank customers, "Age" and "Balance" are two numeric attributes, and "CardLoan" is a 
Boolean attribute. Taking the pair (Age, Balance) as a point in two-dimensional space, we consider an association 
rule of the form ((Age, Balance) in P) implies (CardLoan=Yes), which implies that bank customers whose ages and 
balances fall within a planar region P tend to take out credit card loans with a high probability. We consider two 
classes of regions, rectangles and admissible (i.e., connected and x-monotone) regions. For each class, we propose 
efficient algorithms for computing the regions that give optimal association rules for gain, support, and confidence, 
respectively. We have implemented the algorithms for admissible regions as well as several advanced functions 
based on them in our data mining system named SONAR (System for Optimized Numeric Association Rules), 
where the rules are visualized by using a graphic user interface to make it easy for users to gain an intuitive 
understanding of rules. (35 Refs) 
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